Notes on Markov Networks
نویسنده
چکیده
منابع مشابه
Math 484/884 Data Networks
Supplemental Course Notes Please note that there are likely many typos in the file. These will be corrected over time. The notes are mainly based on the instructor's lecture notes as well as some references that are particularly acknowledged. Further references will be included in the bibliography. Standard material on probability measures and Markov Chains are available in many texts, and no p...
متن کاملEE 550 : Notes on Markov chains , Travel Times , and Opportunistic Routing
This collection of notes provides a brief review of Markov chain theory. It focuses attention on expected travel times and applications to opportunistic routing in wireless networks. The exercises are provided for your own interest.
متن کاملArrival probability in the stochastic networks with an established discrete time Markov chain
The probable lack of some arcs and nodes in the stochastic networks is considered in this paper, and its effect is shown as the arrival probability from a given source node to a given sink node. A discrete time Markov chain with an absorbing state is established in a directed acyclic network. Then, the probability of transition from the initial state to the absorbing state is computed. It is as...
متن کاملProduct Form Approximation of Transient Probabilities in Stochastic Reaction Networks
Most Markov chains that describe networks of stochastic reactions have a huge state space. This makes exact analysis infeasible and hence the only viable approach, apart from simulation, is approximation. In this paper we derive a product form approximation for the transient probabilities of such Markov chains. The approximation can be interpreted as a set of interacting time inhomogeneous Mark...
متن کاملExpected Duration of Dynamic Markov PERT Networks
Abstract : In this paper , we apply the stochastic dynamic programming to approximate the mean project completion time in dynamic Markov PERT networks. It is assumed that the activity durations are independent random variables with exponential distributions, but some social and economical problems influence the mean of activity durations. It is also assumed that the social problems evolve in ac...
متن کامل